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Abstract 

In  this  paper  we  describe  an  implemented  program  for  localizing 
the  expression  of  many  types  of  syntactic  ambiguity,  in  the  logical 
forms  of  sentences,  in  a  manner  convenient  for  subsequent  inferential 
processing.  Among  the  types  of  ambiguities  handled  are  prepositional 
phrases,  very  compound  nominals,  adverbials,  relative  clauses,  and 
preposed  prepositional  phrases.  The  algorithm  we  use  is  presented, 
and  several  possible  shortcomings  and  extensions  of  our  method  are 
discussed. 


1  Introduction 

Ambiguity  is  a  problem  in  any  natural  language  processing  system.  Large 
grammars  tend  to  produce  large  numbers  of  alternative  analyses  for  even 
relatively  simple  sentences.  Furthermore,  cis  is  well  known,  syntactic  infor¬ 
mation  may  be  insufficient  for  selecting  a  best  reading.  It  may  take  semantic 
knowledge  of  cirbitraxy  complexity  to  decide  which  alternative  to  choose. 

In  the  TACITUS  project  [Hobbs,  1986;  Hobbs  and  Martin,  1987]  we 
are  developing  a  pragmatics  component  whicli,  given  the  logical  form  of 
a  sentence,  uses  world  knowledge  to  solve  various  interpretation  problems, 
the  resolution  of  syntactic  ambiguity  among  them.  Sentences  are  translated 
into  logical  form  by  the  DIALOGIC  system  for  syntactic  and  semantic  ancd- 
ysis  [Grosz  et  cd.,  1982].  In  this  paper  we  describe  how  information  about 
cdternative  parses  is  pcissed  concisely  from  DIALOGIC  to  the  pragmatics 
component,  and  more  generally,  we  discuss  a  method  of  localizing  the  rep¬ 
resentation  of  syntactic  ambiguity  in  the  logiccil  form  of  a  sentence. 

One  possible  approach  to  the  ambiguity  problem  would  be  to  produce 
a  set  of  logical  forms  for  a  sentence,  one  for  each  parse  tree,  and  to  send 
them  one  at  a  time  to  the  pragmatics  component.  This  involves  considerable 
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duplicatioE  of  effort  if  the  logical  forms  are  largely  the  same  and  differ  only 
with  respect  to  attachment.  A  more  efficient  approach  is  to  try  to  localize 
the  information  about  the  alternate  possibilities. 

Instead  of  feeding  two  logical  forms,  which  differ  only  with  respect  to  an 
attachment  site,  to  a  pragmatics  component,  it  is  worthwhile  trying  to  con¬ 
dense  the  information  of  the  two  logical  forms  together  into  one  expression 
with  a  disjunction  inside  it  representing  the  attachment  ambiguity.  That 
one  expression  may  then  be  given  to  a  pragmatics  component  with  the  ef¬ 
fect  that  parts  of  the  sentence  that  would  have  been  processed  twice  are  now 
processed  only  once.  The  savings  can  be  considerably  more  dramatic  when 
a  set  of  five  or  ten  or  twenty  logical  forms  can  be  reduced  to  one,  zis  is  often 
the  case. 

In  effect,  this  approach  translates  the  syntactic  ambiguity  problem  into 
a  highly  constrained  coreference  problem.  It  is  as  though  we  translated  the 
sentence  in  (1)  into  the  two  sentences  in  (2) 

(1)  John  drove  down  the  street  in  a  car. 

(2)  John  drove  down  the  street.  It  was  in  a  car. 

where  we  knew  “it”  had  to  refer  either  to  the  street  or  to  the  driving.  Since 
coreference  is  one  of  the  phenomena  the  pragmatics  component  is  designed  to 
cope  with  [Hobbs  and  Martin,  1987],  such  a  translation  represents  progress 
toward  a  solution. 

The  rest  of  this  paper  describes  the  procedures  we  use  to  produce  a  re¬ 
duced  set  of  logical  forms  from  a  larger  set.  The  basic  strategy  hinges  on  the 
idea  of  a  neutral  representation  [Hobbs,  1982].  This  is  similar  to  the  idea 
behind  Church’s  Pseudo-attachment  [Church,  1980],  Pereira’s  Rightmost 
Normzd  Form  [Pereira,  1983],  and  what  Rich  et  al.  refer  to  zis  the  Procrtis- 
tination  Approach  to  parsing  [Rich,  Barnett,  Wittenburg,  and  Whittemore, 
1986].  However,  by  expressing  the  ambiguity  as  a  disjunction  in  logicad 
form,  we  put  it  into  the  form  most  convenient  for  subsequent  inferential 
processing. 

2  Range  of  Phenomena 

2.1  Attachment  Possibilities 

There  are  three  representative  classes  of  attachment  ambiguities,  and  we 
have  implemented  our  approach  to  each  of  these.  For  each  class,  we  give 
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representative  examples  and  show  the  relevant  logical  form  fragments  that 
encode  the  set  of  possible  attachments. 

In  the  first  class  are  those  constituents  that  may  attach  to  either  nouns 
or  verbs. 

(3)  John  saw  the  man  with  the  telescope. 

The  prepositional  phrase  (PP)  “with  the  telescope”  can  be  attached  either 
to  “the  man”  or  to  “saw”.  If  m  stands  for  the  man,  t  for  the  telescope,  and 
e  for  the  seeing  event,  the  neutral  logical  form  for  the  sentence  includes 

...  A  with{y,  t)  A  [y  =  m  y  y  =  e]  A  .. . 

That  is,  something  y  is  with  the  telescope,  and  it  is  either  the  man  or  the 
seeing  event. 

Gerund  modifiers  may  also  modify  nouns  and  verbs,  resulting  in  ambi¬ 
guities  like  that  in  the  sentence 

I  saw  the  Grand  Canyon,  flying  to  New  York. 

Their  treatment  is  identical  to  that  of  PPs.  If  5  is  the  Grand  Canyon,  n  is 
New  York,  and  e  is  the  seeing  event,  the  neutral  logical  form  will  include 

...  A  fly{y,  n)  A  [y  =  g  y  y  =  e]  A  ... 

That  is,  something  y  is  flying  to  New  York,  and  it  is  either  the  Grand  Canyon 
or  the  seeing  event.^ 

In  the  second  class  are  those  constituents  that  can  only  attach  to  verbs, 
such  as  adverbials. 

George  said  Sam  left  his  wife  yesterday. 

Here  “yesterday”  can  modify  the  saying  or  the  leaving  but  not  “his  wife”. 
Suppose  we  take  yesterday  to  be  a  predicate  that  applies  to  events  and 
specifies  something  about  their  times  of  occurrence,  and  suppose  Ci  is  the 
leaving  event  and  €2  the  saying  event.  Then  the  neutral  logical  form  will 
include 

...  A  yesterday{y)  A  [y  =  e-i  y  y  =  €2]  A  .. . 

^If  the  seeing  event  is  flying  to  New  York  we  can  infer  that  the  seer  is  also  flying  to 
New  York. 
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That  is,  something  y  was  yesterday  and  it  is  either  the  leaving  event  or  the 
saying  event. 

Related  to  this  is  the  case  of  a  relative  clause  where  the  preposed  con¬ 
stituent  is  a  PP,  which  could  have  been  extracted  from  any  of  several  em¬ 
bedded  clauses.  In 

That  was  the  week  during  which  George  thought  Sam  told  his 
wife  he  was  leaving, 

the  thinking,  the  telling,  or  the  leaving  could  have  been  during  the  week. 
Let  w  be  the  week,  ey  the  thinking,  the  telling,  and  63  the  leaving.  Then 
the  neutral  logical  form  will  include 

...  A  duTing(y,w)  A  [y  =  ei  V  y  =  €2 
V  y  =  63]  A  ... 

That  is,  something  y  was  during  the  week,  and  y  is  either  the  thinking,  the 
telling,  or  the  leaving. 

The  third  class  contains  those  constituents  that  may  only  attach  to 
nouns,  e.g.,  relative  clauses. 

This  component  recycles  the  oil  that  flows  through  the  compres¬ 
sor  that  is  stiU  good. 

The  second  relative  clause,  “that  is  stiU  good,”  can  attach  to  “compres¬ 
sor”,  or  “oil”,  but  not  to  “flows”  or  “recycles”.  Let  0  be  the  oil  and  c  the 
compressor.  Then,  ignoring  “stiU”,  the  neutral  logical  form  wiU  include 

...  A  good{y)  A  [y  =  cV  y  =  o]A  ... 

That  is,  something  y  is  still  good,  and  y  is  either  the  compressor  or  the  oil. 
Similar  to  this  are  the  compound  nominal  ambiguities,  as  in 

He  inspected  the  oil  filter  element. 

“Oil”  could  modify  either  “filter”* or  “element”.  Let  o  be  the  oil,  /  the  filter, 
e  the  element,  and  rni  the  implicit  relation  that  is  encoded  by  the  nominal 
compound  construction.  Then  the  neutral  logical  form  will  include 

...  A  nn{f,  e)  A  nn(o,  y)  A  [y  =  /  V  y  =  e]  A  . . . 
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That  is,  there  is  some  implicit  relation  nn  between  the  filter  and  the  element, 
and  there  is  another  implicit  relation  nn  between  the  oil  and  something  y, 
where  y  is  either  the  filter  or  the  element. 

Our  treatment  of  all  of  these  types  of  ambiguity  has  been  implemented. 

In  fact,  the  distinction  we  base  the  attachment  possibilities  on  is  not 
that  between  nouns  and  verbs,  but  that  between  event  variables  and  entity 
variables  in  the  logical  form.  This  means  that  we  would  generate  logical 
forms  encoding  the  attachment  of  adverbials  to  event  nominalizations  in 
those  cases  where  the  event  nouns  are  translated  with  event  variables.  Thus 
in 


I  read  about  Judith’s  promotion  Icist  year. 

“Icist  year”  would  be  taken  as  modifying  either  the  promotion  or  the  reading, 
if  “promotion”  were  represented  by  an  event  variable  in  the  logical  form. 

2.2  Single  or  Multiple  Parse  Trees 

In  addition  to  classifying  attachment  phenomena  in  terms  of  which  kind  of 
constituent  something  may  attach  to,  there  is  another  dimension  along  which 
we  need  to  classify  the  phenomena:  does  the  DIALOGIC  parser  produce  all 
possible  parses,  or  only  one?  For  some  regular  structural  ambiguities,  such  as 
very  compound  nominals,  and  the  “during  which”  examples,  only  a  single 
parse  is  produced.  In  this  case  it  is  straightforward  to  produce  from  the 
parse  a  neutral  representation  encoding  all  the  possibilities.  In  the  other 
Ccises,  however,  such  as  (nonpreposed)  PPs,  adverbials,  and  relative  clauses, 
DIALOGIC  produces  an  exhaustive  (and  sometimes  exhausting)  list  of  the 
different  possible  structures.  This  distinction  is  an  artifact  of  our  working 
in  the  DIALOGIC  system.  It  would  be  preferable  if  there  were  only  one 
tree  constructed  which  Wtis  somehow  neutral  with  respect  to  attachment. 
However,  the  DIALOGIC  grammar  is  large  and  complex,  and  it  would  have 
been  difficult  to  implement  such  an  approach.  Thus,  in  these  cases,  one  of 
the  parses,  the  one  corresponding  to  right  association  [Kimball,  1973],  is 
selected,  and  the  neutral  representation  is  generated  from  that.  This  makes 
it  necessary  to  suppress  redundant  readings,  as  described  below.  (In  fact, 
limited  heuristics  for  suppressing  multiple  parse  trees  have  recently  been 
implemented  in  DIALOGIC.) 
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2.3  Thematic  Role  Ambiguities 

Neutral  representations  are  constructed  for  one  other  kind  of  ambiguity  in 
the  TACITUS  system — ambiguities  in  the  thematic  role  or  case  of  the  argu¬ 
ments.  In  the  sentence 

It  broke  the  window. 

we  don’t  know  whether  “it”  is  the  agent  or  the  instrument.  Suppose  the 
predicate  break  takes  three  arguments,  an  agent,  a  patient,  and  an  instru¬ 
ment,  and  suppose  x  is  whatever  is  referred  to  by  “it”  and  w  is  the  window. 
Then  the  neutral  logical  form  wiU  include 

...  A  bTeak{yi,w,  Jf2)  A  [yi  =  a;  V  y2  =  A  . . . 

That  is,  something  y\  breaks  the  window  with  something  else  y2,  and  either 
yi  or  y2  is  whatever  is  referred  to  by  “it”.^ 

2.4  Ambiguities  Not  Handled 

There  are  other  types  of  structural  ambiguity  about  which  we  have  little  to 
say.  In 

They  will  win  one  day  in  Hawaii, 

one  of  the  obvious  readings  is  that  “one  day  in  Hawaii”  is  an  adverbial 
phrase.  However,  another  perfectly  reasonable  reading  is  that  “one  day  in 
Hawaii”  is  the  direct  object  of  the  verb  “win”.  This  is  due  to  the  verb 
having  more  than  one  subcategorization  frame  that  could  be  fiHed  by  the 
surrounding  constituents.  It  is  the  existence  of  this  kind  of  ambiguity  that 
led  to  the  approach  of  not  having  DIALOGIC  try  to  build  a  single  neutral 
representation  in  all  cases.  A  neutral  representation  for  such  sentences, 
though  possible,  would  be  very  complicated. 

SimUariy,  we  do  not  attempt  to  produce  neutral  representations  for  for¬ 
tuitous  or  unsystematic  ambiguities  such  as  those  exhibited  in  sentences 
like 

They  are  flying  planes. 

Time  flies  like  an  arrow. 

Becky  saw  her  duck. 

^The  treatment  of  thematic  role  ambiguities  has  been  implemented  by  Paul  Martin  as 
part  of  the  interface  between  DIALOGIC  and  the  pragmatic  processes  of  TACITUS  that 
translates  the  logical  forms  of  the  sentences  into  a  canonical  representation. 
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2.5  Resolving  Ambiguities 

It  is  beyond  the  scope  of  this  paper  to  describe  the  pragmatics  processing 
that  is  intended  to  resolve  the  ambiguities  (see  Hobbs  and  Martin,  1987). 
Nevertheless,  we  discuss  one  nontrivial  example,  just  to  give  the  reader  a 
feel  for  the  kind  of  processing  it  is.  Consider  the  sentence 

We  retained  the  filter  element  for  future  analysis. 

We  would  like  the  system  to  infer  that  the  right  reading  is  that  “for  future 
analysis”  modifies  the  verb  “retain”  and  not  the  NP  “filter  element”. 

Let  r  be  the  retaining  event,  /  the  filter  element,  and  a  the  cuialysis. 
Then  the  logical  form  for  the  sentence  will  include 

...  A  for{y, a)  A  [y  =  f  V  y  =  r]  A  .. . 

The  predicate  /or,  let  us  say,  requires  the  relation  €nable{y,a)  to  obtain 
between  its  arguments.  That  is,  if  y  is  for  a,  then  either  y  or  something 
coercible  from  y  must  somehow  enable  a  or  something  coercible  from  a.  The 
TACITUS  knowledge  base  contains  axioms  encoding  the  fact  that  having 
something  is  a  prerequisite  for  analyzing  it  and  the  fact  that  a  retaining  is 
a  having,  y  can  thus  be  equal  to  r,  which  is  consistent  with  the  constraints 
on  y.  On  the  other  hand,  any  inference  that  the  filter  element  enables  the 
analysis  will  be  much  less  direct,  and  consequently  will  not  be  chosen. 

3  The  Algorithm 

3.1  Finding  Attachment  Sites 

The  logical  forms  (LFs)  that  are  produced  from  each  of  the  parse  trees 
are  given  to  an  attachment-finding  program  which  adds,  or  makes  explicit, 
information  about  possible  attachment  sites.  Where  this  makes  some  LFs 
redundant,  as  in  the  prepositional  phrase  case,  the  redundant  LFs  axe  then 
eliminated. 

For  instance,  for  the  sentence  in  (4), 

(4)  John  saw  the  mm  in  the  park  with  the  telescope. 

DIALOGIC  produces  five  parse  trees,  and  five  corresponding  logical  forms. 
When  the  attachment-finding  routine  is  run  on  an  LF,  it  annotates  the  LF 
with  information  about  a  set  of  variables  that  might  be  the  subject  (i.e.,  the 
attachment  site)  of  each  PP. 
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The  example  below  shows  the  LFs  for  one  of  the  five  readings  before 
and  after  the  attachment-finding  routine  is  run  on  it.  They  are  somewhat 
simplified  for  the  purposes  of  exposition.  In  this  notation,  a  proposition 
is  a  predicate  followed  by  one  or  more  arguments.  An  argument  is  a  vari¬ 
able  or  a  complex  term.  A  complex  term  is  a  variable  followed  by  a  “such 
that”  symbol  “  |  followed  by  a  conjunction  of  one  or  more  propositions.^ 
Complex  terms  are  enclosed  in  square  brackets  for  readability.  Events  are 
represented  by  event  variables,  as  in  [Hobbs,  1985],  so  that  see'(ei, ii,  12) 
means  gj  is  a  seeing  event  by  a: j  of  12- 

One  of  sentence  (4)’s  LFs  before  attachment-finding  is 

past([ei  I  see'(ei, 

[ii  [  Jo/in(xi)], 

[12  i  771071(12)  A 

in(s2,[®3  I  park{x3)A 

with{x3,[xi  \  ielescope(a:4)])])])]) 
The  same  LF  after  attachment-finding  is 
past([ei  I  see'(ei, 

[ii  I  Jo/l77(Xi)], 

[12  I  771077(12)  A 

I  yi  =  V  yi  =  Cl], 

[13  I  park{x3)A 

with{[y2  I  y2=X3  V  y2=X2  V  y2=ei], 

[x4  I  te/escope(i4)])])])]) 

A  paraphrase  of  the  latter  LF  in  English  would  be  something  like  this: 
There  is  an  event  ei  that  happened  in  the  past;  it  is  a  seeing  event  by  xi 
who  is  John,  of  X2  who  is  the  man;  something  yi  is  in  the  park,  and  that 
something  is  either  the  man  or  the  seeing  event;  something  y2  is  with  a 
telescope,  and  that  something  is  the  park,  the  man,  or  the  seeing  event. 

The  procedure  for  finding  possible  attachment  sites  in  order  to  modify 
a  logical  form  is  as  follows.  The  program  recursively  descends  an  LF,  and 
keeps  lists  of  the  event  and  entity  variables  that  initiate  complex  terms. 
Event  variables  associated  with  tenses  are  omitted.  When  the  program 
arrives  at  some  part  of  the  LF  that  can  have  multiple  attachment  sites, 

^This  notation  can  be  translated  into  a  Russellian  notation,  with  the  consequent  loss 
of  information  about  grammatical  subordination,  by  repeated  application  of  the  transfor¬ 
mation  p(x  I  Q)  p(x)  A  Q. 
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it  replaces  the  explicit  argument  by  an  existentially  quantified  variable  y, 
determines  whether  it  can  be  an  event  variable,  an  entity  variable,  or  either, 
and  then  encodes  the  list  of  possibilities  for  what  y  could  equal. 

3.2  Eliminating  Redundant  Logical  Forms 

In  those  cases  where  more  than  one  parse  tree,  and  hence  more  than  one  log¬ 
ical  form,  is  produced  by  DIALOGIC,  it  is  necessary  to  eliminate  redundant 
readings.  In  order  to  do  this,  once  the  attachment  possibilities  are  registered, 
the  LFs  are  flattened  (thus  losing  temporarily  the  grammatical  subordina¬ 
tion  information),  and  some  simplifying  preprocessing  is  done.  Each  of  the 
flattened  LFs  is  compared  with  the  others.  Any  LF  that  is  subsumed  by 
another  is  discarded  as  redundant.  One  LF  subsumes  another  if  the  two 
LFs  are  the  same  except  that  the  first  has  a  list  of  possible  attachment  sites 
that  includes  the  corresponding  list  in  the  second.  For  example,  one  LF 
for  sentence  (3)  says  that  “with  the  telescope”  can  modify  either  “saw”  or 
“the  man”,  and  one  says  that  it  modifies  “saw”.  The  first  LF  subsumes  the 
second,  and  the  second  is  discarded  and  not  compared  with  any  other  LFs. 
Thus,  although  the  LFs  are  compared  pairwise,  if  all  of  the  ambiguity  is  due 
to  only  one  attachment  indeterminacy,  each  LF  is  looked  at  only  once. 
Frequently,  only  some  of  the  alternatives  may  be  thrown  out.  For 

Andy  said  he  lost  yesterday 

after  attachment-finding,  one  logical  form  allows  “yesterday”  to  be  attached 
to  either  the  saying  or  the  losing,  while  another  attaches  it  only  to  the 
saying.  The  second  is  subsumed  by  the  first,  and  thus  discarded.  However, 
there  is  a  third  reading  in  which  “yesterday”  is  the  direct  object  of  “lost” 
and  this  neither  subsumes  nor  is  subsumed  by  the  others  and  is  retained. 

4  Lost  Information 

4.1  Crossing  Dependencies 

Our  attachment-finding  routine  constructs  a  logical  form  that  describes  all  of 
the  standard  readings  of  a  sentence,  but  it  also  describes  some  nonstandard 
readings,  namely  those  corresponding  to  parse  trees  with  crossing  branches, 
or  crossing  dependencies.  An  example  would  be  a  reading  of  (4)  in  which 
the  seeing  was  in  the  park  and  the  man  was  with  the  telescope. 
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For  small  numbers  of  possible  attachment  sites,  this  is  an  acceptable 
result.  If  a  sentence  is  two- ways  ambiguous  (due  just  to  attachment),  we 
get  no  wrong  readings.  If  it  is  five- ways  ambiguous  on  the  standard  analysis, 
we  get  six  readings.  However,  in  a  sentence  with  a  sequence  of  four  PPs, 
the  standard  analysis  (and  the  DIALOGIC  parser)  get  42  readings,  whereas 
our  single  disjunctive  LF  stands  for  120  different  readings. 

Two  things  can  be  said  about  what  to  do  in  these  cases  where  the  two 
approaches  diverge  widely.  We  could  argue  that  sentences  with  sucli  cross¬ 
ing  dependencies  do  exist  in  English.  There  are  some  plausible  sounding 
examples. 

Specify  the  length,  in  bytes,  of  the  word. 

Kate  saw  a  man  on  Sunday  with  a  wooden  leg. 

In  the  first,  the  phrase  “in  bytes”  modifies  “specify”,  and  “of  the  word” 
modifies  “the  length”.  In  the  second,  “on  Sunday”  modifies  “saw”  and 
“with  a  wooden  leg”  modifies  “a  man”.  Stucky  [1987]  argues  that  such 
examples  are  acceptable  <ind  quite  frequent. 

On  the  other  hand,  if  one  feels  that  these  putative  examples  of  cross¬ 
ing  dependencies  can  be  explained  away  and  should  be  ruled  out,  there 
is  a  way  to  do  it  within  our  framework.  One  can  encode  in  the  LFs  a 
crossing-dependencies  constraint,  and  consult  that  constraint  when  doing 
the  pragmatic  processing. 

To  handle  the  crossing-dependencies  constraint  (which  we  have  not  yet 
implemented),  the  program  would  need  to  keep  the  list  of  the  logical  vari¬ 
ables  it  constructs.  This  list  would  contain  three  kinds  of  variables,  event 
variables,  entity  variables,  and  the  special  variables  (the  j/’s  in  the  LFs 
above)  representing  attachment  ambiguities.  The  list  would  keep  track  of 
the  order  in  which  variables  were  encountered  in  descending  the  LF.  A  sep¬ 
arate  list  of  just  the  special  y  variables  also  needs  to  be  kept.  The  strategy 
would  be  that  in  trying  to  resolve  referents,  whenever  one  tries  to  instanti¬ 
ate  a  y  variable  to  something,  the  other  y  variables  need  to  be  checked,  in 
accordance  with  the  following  constraint: 

There  cannot  be  yi,  y2  in  the  list  of  y’s  such  that  B(j/i)  < 

B{y2)  <  yi  <  y2i  where  B[yi)  is  the  proposed  variable  to 
which  yi  will  be  bound  or  with  which  it  will  be  coreferenticd, 
and  the  <  operator  means  “precedes  in  the  list  of  variables”. 

This  constraint  handles  a  single  phrase  that  has  attachment  ambiguities. 
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It  also  works  in  the  case  where  there  is  a  string  of  PPs  in  the  subject  NP, 
and  then  a  string  of  PPs  in  the  object  NP,  as  in 

The  man  with  the  telescope  in  the  park  lounged  on  the  bank  of 
a  river  in  the  sun. 

With  the  appropriate  crossing- dependency  constraints,  the  logical  form  for 
this  would  be'^ 

pa5t([ei  [  lounge'(ei, 

[ii  I  man^xi)  A 

with{[yi  1  =  xi  V  pi  =  ei], 

[x2  I  telescope{x2) A 

i«([2/2  I  y2=a:2Vp2=a:iVp2=ei], 

[X3  I  parfc(x3)])])])A 

on(ei, 

[x4  I  bank(x4) 

ofdVs  I  y3  =  X4  V  y3  =  ei], 

[is  I  river(x5) A 

in([2/4  I  y4=xs  V  ^4=2:4  V  J/4=ei], 

[is  I  5U7i(i6)])])])  A 

crossing-in fo{<  ei,ii,yi,i2,  ^2,13  >,  2^2})  A 

crossing-inf o{<  61,14,^3,15,2/4,2:6  >,  {j/3,  J/4})]) 


4.2  Noncoreference  Constraints 

One  kind  of  information  that  is  provided  by  the  DIALOGIC  system  is  infor¬ 
mation  about  coreference  and  noncoreference  insofar  as  it  can  be  determined 
from  syntactic  structure.  Thus,  the  logical  form  for 

John  saw  him. 

includes  the  information  that  “John”  and  “him”  cannot  be  coreferential. 
This  interacts  with  our  localization  of  attachment  ambiguity.  Consider  the 
sentence, 

John  returned  BUl’s  gift  to  him. 

■‘We  are  assuming  “with  the  telescope”  and  “in  the  park”  can  modify  the  lounging, 
which  they  certainly  can  if  we  place  commas  before  and  after  them. 
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If  we  attach  “to  him”  to  “gift”,  “him”  can  be  coreferential  with  “John”  but 
it  cannot  be  coreferential  with  “Bill”.  If  we  attach  it  to  “returned”,  “him” 
can  be  coreferential  with  “Bill”  but  not  with  “John”.  It  is  therefore  not 
enough  to  say  that  the  “subject”  of  “to”  is  either  the  gift  or  the  returning. 
Each  alternative  carries  its  own  noncoreference  constraints  with  it.  We  do 
not  have  an  elegant  solution  to  this  problem.  We  mention  it  because,  to  our 
knowledge,  this  interaction  of  noncoreference  constraints  and  PP  attachment 
has  not  been  noticed  by  other  researchers  taking  similar  approaches, 

5  A  Note  on  Literal  Meaning 

There  is  an  objection  one  could  make  to  our  whole  approach.  If  our  logical 
forms  are  taken  to  be  a  representation  of  the  “literal  meaning”  of  the  sen¬ 
tence,  then  we  would  seem  to  be  making  the  claim  that  the  literal  meaning 
of  sentence  (2)  is  “Using  a  telescope,  John  saw  a  man,  or  John  saw  a  man 
who  had  a  telescope,”  whereas  the  real  situation  is  that  either  the  literal 
meaning  is  “Using  a  telescope,  John  saw  a  man,”  or  the  literal  meaning 
is  “John  saw  a  man  who  had  a  telescope.”  The  disjunction  occurs  in  the 
metalanguage,  whereas  we  may  seem  to  be  claiming  it  is  in  the  language. 

The  misunderstanding  behind  this  objection  is  that  the  logical  form  is 
not  intended  to  represent  “literal  meaning”.  There  is  no  general  agreement 
on  precisely  what  constitutes  “literal  meaning”,  or  even  whether  it  is  a 
coherent  notion.  In  any  case,  few  would  argue  that  the  meaning  of  a  sentence 
could  be  determined  on  the  basis  of  syntactic  information  aJone.  The  logical 
forms  produced  by  the  DIALOGIC  system  are  simply  intended  to  encode  all 
of  the  information  that  syntactic  processing  can  extract  about  the  sentence. 
Sometimes  the  best  we  can  come  up  with  in  this  phase  of  the  processing 
is  disjunctive  information  about  attachment  sites,  and  that  is  what  the  LF 
records. 

6  Future  Extensions 

6.1  Extending  the  Range  of  Phenomena 

The  work  that  has  been  done  demonstrates  the  feasibility  of  localizing  in 
logical  form  information  about  attachment  ambiguities.  There  is  some  mun¬ 
dane  programming  to  do  to  handle  the  cases  similar  to  those  described  here. 
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e.g.,  other  forms  of  postnominal  modification.  There  is  also  the  crossing- 
dependency  constraint  to  implement. 

The  principal  area  in  which  we  intend  to  extend  our  approach  is  various 
kinds  of  conjunction  ambiguities.  Our  approach  to  some  of  these  ccises  is 
quite  similar  to  what  we  have  presented  already.  In  the  sentence, 

(5)  Mary  told  us  John  was  offended  and  George  left  the 
party  early. 

it  is  possible  for  George’s  leaving  to  be  conjoined  with  either  John’s  being 
offended  or  Mary’s  telling.  Following  Hobbs  [1985],  conjunction  is  repre¬ 
sented  in  logical  form  by  the  predicate  and'  taking  a  self  argument  and  two 
event  variables  as  its  arguments.  In  (5)  suppose  ei  stands  for  the  telling, 
for  the  being  offended,  63  for  the  leaving,  and  eo  for  the  conjunction.  Then 
the  neutral  representation  for  (5)  would  include 

and'(eo,yo,e3)  A  te//'(ei,  Af, t/i) 

A ((2/0  =  Cl  A  1/1  =  62)  V  (1/0  =  62  A  yi  =  eo)) 

That  is,  there  is  a  conjunction  cq  of  1/0  the  leaving  €3;  there  is  a  telling 
Cl  by  Mary  of  j/i;  and  either  yo  is  the  telling  ei  and  yi  is  the  being  offended 
62,  or  yo  is  the  being  offended  62  and  yi  is  the  conjunction  eo- 

A  different  kind  of  ambiguity  occurs  in  noun  phrase  conjunction.  In 

(6)  Where  are  the  British  ajid  American  ships? 

there  is  a  set  of  British  ships  amd  a  disjoint  set  of  American  ships,  whereas 
in 

(7)  Where  are  the  tall  and  handsome  men? 

the  natural  interpretation  is  that  a  single  set  of  men  is  desired,  consisting 
of  men  who  are  both  tall  and  handsome. 

In  TACITUS,  noun  phrase  conjunction  is  encoded  with  the  predicate 
andn,  taking  three  sets  as  its  arguments.  The  expression  andn($i, 32,33) 
means  that  the  set  S]  is  the  union  of  sets  $2  and  S3.®  Following  Hobbs  [1983], 
the  representation  of  plurals  involves  a  set  and  a  typical  element  of  the  set,  or 
a  reified  universally  quantified  variable  ranging  over  the  elements  of  the  set. 
Properties  like  cardinality  are  properties  of  the  set  itself,  while  properties 

either  si  or  S2  is  not  a.  set,  the  singleton  set  consisting  of  just  that  element  is  used 
instead. 
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that  hold  for  each  of  the  elements  are  properties  of  the  typical  element. 
An  axiom  schema  specifies  that  any  properties  of  the  typical  element  are 
inherited  by  the  individual,  actual  elements.®  Thus,  the  phrase  “British  and 
American  ships”  is  translated  into  the  set  si  such  that 

an6in(si,S2)'S3)  A  typeli{x\^s-i)  A  shif^Xi) 

Aiypelt{x2,S2)  A  BTitish{x2) 

Atypeli{x3,S3)  A  AmeTican{x3) 

That  is,  the  typical  element  xi  of  the  set  si  is  a  ship,  ajid  si  is  the  union 
of  the  sets  S2  and  S3,  where  the  typical  element  12  of  52  is  British,  and  the 
typical  element  X3  of  S3  is  American. 

The  phrase  “tall  and  handsome  men”  can  be  represented  in  the  same 
way. 

andn{si,  62,33)  A  typ€lt{xi,si)  A  Tnan{xi) 

Atypelt{x2,S2)  A  tall{x2) 

Aiypelt(x3,S3)  A  handsome{x3) 

Then  it  is  a  matter  for  pragmatic  processing  to  discover  that  the  set  S2  of 
tcdl  men  and  the  set  S3  of  handsome  men  are  in  fact  identical. 

In  this  representational  framework,  the  treatment  given  to  the  kind  of 
ambiguity  illustrated  in 

I  like  intelligent  men  and  women. 

resembles  the  treatment  given  to  attachment  ambiguities.  The  neutral  log¬ 
ical  form  would  include 

...  A  andn{si,S2,  S3)  A  typ€lt{xi,si) 

Atypelt(x2,S2)  A  man(x2) 

Aiypeli(x3,S3)  A  woman{x3) 

A  intelligeni{y)  A  [j/  =  Xi  V  =  X2] 

That  is,  there  is  a  set  Si,  with  typical  element  x\,  which  is  the  union  of 
sets  S2  and  S3,  where  the  typical  element  X2  of  S2  is  a  man  and  the  typical 
element  X3  of  S3  is  a  woman,  and  something  y  is  intelligent,  where  y  is  either 
the  typical  element  xi  of  si  (the  typical  person)  or  the  typical  element  X2 
of  S2  (the  typical  man). 

Ambiguities  in  conjoined  compound  nominals  can  be  represented  simi¬ 
larly.  The  representation  for 

®The  reader  may  with  some  justification  feel  that  the  term  “typical  element”  is  ill- 
chosen.  He  or  she  is  invited  to  suggest  a  better  term. 
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oil  pump  and  filter 
would  include 

...  A  andn{s,p,f)  A  typelt(x,s)  A  pump{p) 

A  filter{f)  A  oil{o)  A  nn(o,y) 

A  [2/  =  p  V  2/  =  2:] 

That  is,  there  is  a  set  s,  with  typical  element  x,  composed  of  the  elements  p 
and  /,  where  p  is  a  pump  and  /  is  a  filter,  and  there  is  some  implicit  relation 
nn  between  some  oil  0  and  y,  where  y  is  either  the  pump  p  or  the  typical 
element  x  or  s.  (In  the  latter  case,  the  axiom  in  the  TACITUS  system’s 
knowledge  bcise, 

{'^ w,x,y,z,s)nn{w,x)  A  typelt{x,s) 

A  andn{s,  y,z) 

=  nn(w,y)  A  nn{w,z) 

allows  the  nn  relation  to  be  distributed  to  the  two  conjuncts.) 

6.2  Ordering  Heuristics 

So  far  we  have  only  been  concerned  with  specifying  the  set  of  possible  attach¬ 
ment  sites.  However,  it  is  true,  empirically,  that  certain  attachment  sites 
can  be  favored  over  others,  strictly  on  the  basis  of  syntactic  (and  simple 
semantic)  information  alone.^ 

For  example,  for  the  prepositional  phrase  attachment  problem,  an  infor¬ 
mal  study  of  several  hundred  examples  suggests  that  a  very  good  heuristic  is 
obtained  by  using  the  following  three  principles:  (1)  favor  right  cissociation; 
(2)  override  right  association  if  (a)  the  PP  is  temporal  and  the  second  nearest 
attachment  site  is  a  verb  or  event  nominalization,  or  (b)  if  the  preposition 
typically  signals  an  argument  of  the  second  nearest  attachment  site  (verb  or 
relational  noun)  and  not  of  the  nearest  attachment  site;  (3)  override  right 
cissociation  if  a  comma  (or  comma  intonation)  separates  the  PP  from  the 
nearest  attachment  site.  The  preposition“of”  should  be  treated  specially; 
for  “of”  PPs,  right  association  is  correct  over  98%  of  the  time. 

There  are  two  roles  such  a  heuristic  ordering  of  possibilities  can  play.  In  a 
system  without  sophisticated  semantic  or  pragmatic  processing,  the  favored 
attachment  could  simply  be  selected.  On  the  other  hand,  in  a  system  such 

^Thete  is  a  vast  Hteratute  on  this  topic.  For  a  good  introduction,  see  Dowty,  Karttunen, 
and  Zwicky  [1985]. 
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as  TACITUS  in  which  complex  inference  procedures  access  world  knowledge 
in  interpreting  a  text,  the  heuristic  ordering  can  influence  an  allocation  of 
computational  resources  to  the  various  possibilities. 
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Appendix 

John  saw  the  man  with  the  telescope. 
Logical  Form  before  Attachment-Finding: 


((PAST 

(SELF  Ell) 

(SUBJECT 

(E3 

(SEE 

(SELF  E3) 

(SUBJECT  (XI  (JOHN  (SELF  E2)  (SUBJECT  XI)))) 

(OBJECT  (X4  (MAN  (SELF  E5)  (SUBJECT  X4)) 

(WITH  (SELF  E6) 

;  Here  [with]  modifies  [man] 
(PP-SUBJECT  X4) 

(OBJECT  (X7  (TELESCOPE  (SELF  E8) 

(SUBJECT  X7)) 
(THE  (SELF  E9) 

(SUBJECT  X7)) 

(N0T=  (NP  X7) 

(ANTES  (X4)))))) 
(THE  (SELF  ElO)  (SUBJECT  X4)) 

(N0T=  (NP  X4)  (ANTES  (XI)))))))))) 
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Logical  Form  after  Attachment- Finding: 


((PAST 

(SELF  Ell) 

(SUBJECT 

(E3 

(SEE 

(SELF  E3) 

(SUBJECT  (XI  (JOHN  (SELF  E2)  (SUBJECT  XI)))) 

(OBJECT  (X4  (MAN  (SELF  E5)  (SUBJECT  X4)) 

(WITH  (SELF  E6) 

;  Hera  [with]  modifies  [man]  or  [saw] 
(SUBJECT  (yi4  (?=  (NP  Y14) 

(ANTES  (X4  E3))))) 
(OBJECT  (X7  (TELESCOPE  (SELF  E8) 

(SUBJECT  X7)) 
(THE  (SELF  E9) 

(SUBJECT  X7)) 

(NQT=  (NP  X7) 

(ANTES  (X4)))))) 

(THE  (SELF  ElO)  (SUBJECT  X4)) 

(N0T=  (NP  X4)  (ANTES  (XI)))))))))) 
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